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(54) BLOCK DISTORTION ELIMINATOR 
(5 7) Abstract: 

PURPOSE: To obtain an image in which block distortion is eliminated from mosaic 
images. 

CONSTITUTION: An input digital image signal is supplied to a mosaic formation 
circuit 13 via a blocking circuit 12, and its output is supplied to a deblocking circuit 14. 
A digital image signal in which a mosaic is contained is supplied to a picture element 
date extraction circuit 15. An ADRC circuit 16 compresses the digital image signal, and 
a class code generation circuit 17 generates a class code. A normal equation addition 
circuit 19 adds the input digital image signal, the digital image signal from the picture 
element data sampling circuit 15, and the class code by a normal equation, and a 
predictive coefficient is decided by a prediction coefficient decision circuit 21. The 
prediction coefficient is stored in memory 22 every class. 
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CLAIMS 



[Claim(s)] 

[Claim 1] In the block distortion stripper changed into the picture signal which 
removed the block distortion in an input digital image signal The image logging 
means which starts the image data of a position from the image information 
supplied from the outside, A class detection means to detect the pattern of level 
distribution of the image information extracted by the above-mentioned image 
logging means, to determine the class to which that image information belongs 
based on this pattern, and to output class detection information, A class code 
generating means to determine a final class from the result of the class detection 
means by which detection was carried out [ above-mentioned ], The 
presumed-type multiplier data which is the information for changing the image 
information supplied from the above-mentioned outside into the image 
information which removed block distortion are memorized for every 
above-mentioned class. A multiplier data storage means to output the 
above-mentioned multiplier data according to the class detection information 
from the above-mentioned class detection means, The block distortion stripper 
characterized by having an image transformation means to change and output 
the image information supplied by performing a presumed operation to the 



I 



image information which removed block distortion, according to the multiplier 
data supplied from the above-mentioned multiplier data storage means. 
[Claim 2] The block distortion stripper characterized by being the picture signal 
with which the above-mentioned input digital image signal was mosaic-ized in a 
block distortion stripper according to claim 1. 

[Claim 3] In the block distortion stripper changed into the picture signal which 
removed the block distortion in an input digital image signal A blocking means to 
block the image data of a position from the image information supplied from the 
outside, A mosaic-ized means to mosaic-ize the image data by which the 
above-mentioned blocking was made, The block decomposition means for 
making into image information the image data by which the above-mentioned 
mosaic-ization was made, The image logging means which starts the image 
data of a position from the image information by which the above-mentioned 
block decomposition was made, A class detection means to detect the pattern of 
level distribution of the image information extracted by the above-mentioned 
image logging means, to determine the class to which that image information 
belongs based on this pattern, and to output class detection information, A class 
code generating means to determine a final class from the result of the class 



detection means by which detection was carried out [ above-mentioned ], A 
multiplier data generation means to generate the presumed-type multiplier data 
which is the information for changing into the image information which removed 
block distortion from the image information supplied from the above-mentioned 
outside, and the image information by which the above-mentioned block 
decomposition was made, The block distortion stripper characterized by the 
above-mentioned multiplier data consisting of a multiplier data storage means 
memorized for every class. 

[Translation done.] * NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates the image with which block 
distortion like the image mosaic-ized, for example exists to a block distortion 
stripper which removed block distortion and which is visually changed into a 
good image. 
[0002] 

[Description of the Prior Art] When recording and transmitting a digital video 
signal, it is becoming general by the numerousness, therefore high efficiency 
coding of the amount of information to compress a digital video signal. As high 
efficiency coding, block conversion coding of DCT (Discrete Cosine Transform), 
ADRC (Adaptive Dynamic Range Coding), etc. is known. 
[0003] For example, the coding method by DCT tends to divide the television 
signal of one frame into two or more small blocks which consist of horizontal n 
pixel xm pixel, tends to give DCT to each block, and tends to compress amount 
of information by changing and transmitting [ record and ] the multiplier data of 
the dc component obtained as a result, and the multiplier data of two or more 
alternating current components to the entropy sign from which bit length differs 



according to an appearance probability, for example, a Huffman code. 
[0004] When many, even if the rate for record and transmission reduces amount 
of information by compression above to some extent compared with the amount 
of information which an image from the first has, degradation hardly arises in 
image quality. On the other hand, when the rate for record and transmission is 
low, drastic amount-of-information reduction is needed, therefore degradation of 
image quality arises. 

[0005] The situation of image quality degradation changes somewhat with 
classes of high efficiency coding. For example, in compression by DCT, if a 
compression ratio becomes high, in order to delete from the information on a 
high region, characteristic degradation which the feeling of dotage of an image 
becomes strong, and is called a mosquito noise near the edge arises. 
[0006] Furthermore, when compression of a very low rate is performed, the 
so-called block distortion to which the boundary of a block is conspicuous in the 
whole image arises, a screen becomes mosaic-like, and degradation is visually 
conspicuous. Not only in DCT but in ADRC, even when the allotment child-ized 
number of bits is lessened very much, block distortion arises similarly. Thus, 
generating of block distortion at the time of making compressibility high is a 



phenomenon common to block coding. 

[0007] On the other hand, most block distortion mitigating methods currently 
performed from the former were the technique of dropping the band of a signal, 
and it not being conspicuous and carrying out a block boundary by technique, 
such as a low pass filter and linear interpolation. However, according to this 
technique, there were increase of dotage of an image and a trouble that a 
satisfying restoration image could not necessarily be obtained, visually. 
[0008] 

[Problem(s) to be Solved by the Invention] Therefore, this invention is made in 
view of an above-mentioned trouble, and is not based on technique on which a 
band is dropped simply, such as a low pass filter and linear interpolation, but 
aims at offer of the block distortion stripper which can remove block distortion. 
[0009] 

[Means for Solving the Problem] In the block distortion stripper which changed 
invention according to claim 1 into the picture signal which removed the block 
distortion in an input digital image signal The image logging means which starts 
the image data of a position from the image information supplied from the 
outside, A class detection means to detect the pattern of level distribution of the 



image information extracted by the image logging means, to determine the class 
to which that image information belongs based on this pattern, and to output 
class detection information, A class code generating means to determine a final 
class from the result of the detected class detection means, The presumed-type 
multiplier data which is the information for changing the image information 
supplied from the outside into the image information which removed block 
distortion are memorized for every class. A multiplier data storage means to 
output multiplier data according to the class detection information from a class 
detection means, It is the block distortion stripper characterized by having an 
image transformation means to change and output the image information 
supplied by performing a presumed operation to the image information which 
removed block distortion, according to the multiplier data supplied from the 
multiplier data storage means. 

[0010] In the block distortion stripper which changed invention according to claim 

! 

3 into the picture sijgnal which removed the block distortion in an input digital 
image signal A blocking means to block the image data of a position from the 
image information supplied from the outside, A mosaic-ized means to mosaic-ize 
the image data by which blocking was made, The block decomposition means 



for making into image information the image data by which mosaic-ization was 
made, The image logging means which starts the image data of a position from 
the image information by which block decomposition was made, A class 
detection means to detect the pattern of level distribution of the image 
information extracted by the image logging means, to determine the class to 
which that image information belongs based on this pattern, and to output class 
detection information, A class code generating means to determine a final class 
from the result of the detected class detection means, A multiplier data 
generation means to generate the presumed-type multiplier data which is the 
information for changing into the image information which removed block 
distortion from the image information supplied from the outside, and the image 
information by which block decomposition was made, It is the block distortion 
stripper characterized by multiplier data consisting of a multiplier data storage 
means memorized for every class. 
[0011] 

[Function] From an input digital image signal, using the pixel data of the block 
near the object block from which it is going to remove block distortion, the block 
distortion stripper concerning this invention detects the pattern of level 
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distribution, and performs a class classification. On the other hand, the multiplier 
data of the linearity presumption type which is the information for changing the 
mosaic-ized image information which was supplied from the outside into the 
image information which removed block distortion are memorized by the 
multiplier data storage means for every class, and this multiplier data is 
outputted according to class detection information. And the mosaic-ized image 
information to which the presumed operation means was supplied from the 
outside according to the multiplier data supplied from the multiplier data storage 
means is changed into the image information which removed block distortion. 
[0012] 

[Example] It explains to a detail, referring to a drawing about one example of the 
block distortion stripper concerning this invention hereafter. Drawing 1 shows the 
rough configuration of signal processing of this one example, i.e., a block 
distortion stripper. From the input terminal shown by 1 , the digitized picture 
signal is supplied as image information supplied from the outside. In addition, the 
picture signal supplied here is divided into a mosaic-like picture signal, i.e., a 
small block, and is made into the signal in which that the block of each has the 
same brightness value. However, this invention is not limited to the same 
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brightness value, biiit the brightness value change within a block can make it the 
object of processing as an image with which very few images were also 
mosaic-ized. 

[0013] The picture signal supplied from the input terminal 1 is supplied to the 
pixel data extraction circuit 2. The pixel data extraction circuit 2 serves to extract 
pixel data required in order to patternize level distribution of the near data of an 
object block from which block distortion is removed. In this example, 1 pixel and 
a total of 9 pixels (x1 -x9) are extracted from the object block B (0 0) which 
removes block distortion as shown in drawing 3 , and 8 blocks (B (-1 , -1) - B (1 
1)) of the circumference of it, respectively. It is mosaic data, and since it is 
uniform, if the brightness value within a block is in a predetermined block, it is 
good anywhere. [ of the location of the pixel to take out ] The output signal of the 
pixel data extraction circuit 2 is supplied to the ADRC circuit 3. 
[0014] The ADRC circuit 3 patternizes the wave in space of the supplied pixel 
data with the small number of bits, and performs an operation which compresses 
into 2-bit data the pixel data which consist of 9 pixels supplied from the pixel data 
extraction circuit 2 for the purpose of performing the wave-like class 
classification from 8-bit data. 



[0015] Originally, although ADRC (Adaptive Dynamic Range Coding) is the 
accommodative quantizing method developed for [ for digital video tape 
recorders ] high efficiency coding, since it can express the local pattern of signal 
level efficiently by the short word length, it is used for code generating for a class 
classification of a signal pattern in this example. The ADRC circuit 3 is equally 
divided by the bit length which it set [ bit length / bit allocation ] L and a 
re-quantization code to Q for the data level of n and the pixel in a field by having 
set the dynamic range in a field to DR, and had between the maximum MAX in a 
field, and the minimum values MIN specified by the following formulas (1), and 
performs re-quantization. 
[0016] 

DR=MAX-MIN +1 Q= [(L-MIN +0.5) -2n / DR] (1) 
However, [ ] means a cut-off. 

[0017] In this example, it shall compress each into 2 bits the 9-pixel data 
extracted by the pixel data extraction circuit 2. It is compressed data, 
respectively q1 -q9 It carries out. Moreover, DR-class of 4 level is computed with 
a threshold as shows the dynamic range DR detected at that time to the 
following prepared beforehand. 



[0018] 

case of dynamic range DR<=8 : case [ of DR-classO dynamic-range DR<=16 ]: - 
case [ of DR-class1 dynamic-range DR<=36 ]: - case [ of DR-class2 
dynamic-range DR>36 ]: - pixel data q1 -q9 compressed into the output signal 
of the DR-class3ADRC circuit 3, i.e., 2 bits each, And DR-class is supplied to the 
class code generating circuit 4. 

[0019] The class code generating circuit 4 is pattern compressed data q1 -q9 
supplied from the ADRC circuit 3. And class code class which detects the class 
to which the pixel data extracted by calculating the following formulas (2) based 
on DR-class belong, and shows the class The ROM table 5 is supplied. This 
class code class The read-out address from the ROM table 5 is shown. 
[0020] 
[Equation 1] 

In this example, n is 9 and p is 2. 

[0021] The multiplier data for carrying out the presumed operation of the data 
corresponding to the mosaic-ized data before mosaic-izing using a linearity 



presumption type are memorized for every class by learning the relation of data 
before mosaic-izing with the pattern of data after mosaic-izing on the ROM table 
5. In this example, if multiplier data are the block of the form corresponding to 
each pixel location within a block, 4x4 [ i.e., ], 16 sets of multipliers are prepared 
independently. In addition, about the creation approach of the multiplier data 
memorized by the ROM table 5, it mentions later. From the ROM table 5, it is the 
class code class, wi (class) which is multiplier data of the class is read from the 
address shown. This multiplier data is supplied to the presumed arithmetic circuit 
7. 

[0022] Nine pixel data x1 -x9 started on the other hand in the pixel data 
extraction circuit 2 Only the time amount which the ADRC circuit 3, the class 
code generating circuit 4, and the ROM table 5 take is supplied to the presumed 
arithmetic circuit 7 through the delay circuit 6 which serves to delay a signal. The 
presumed arithmetic circuit 7 performs transform processing (block distortion is 
removed) which removes the mosaic of the inputted image which was 
mosaic-ized based on the pixel data supplied from the pixel data extraction 
circuit 2, and the multiplier data supplied from the ROM table 5. 
[0023] x1 -x9 which is more specifically data with which the presumed arithmetic 



circuit 7 is supplied from the pixel data extraction circuit 2 class determined by 
the class code generating circuit 4 w1 -w9 which is multiplier data supplied from 
the ROM table 5 in the form where it corresponds By calculating using the 
multiplier prepared for every pixel location of the pixel to presume, processing 
which removes the block distortion of the inputted image which was mosaic-ized 
is performed. Block B for block distortion (0 0) As a pixel shows drawing 4 , when 
it is y1 -y16, presumed operation expression is as follows. 
[0024] 

y1 =w1 (y1) x1+w2 (y1) x2+ ... +w9 (y1) x9 y2 =w1 (y2) x1+w2 (y2) x2+ ... +w9 
(y2) x9 ... y16=w1(y16) x1+w2 (y16) x2+ ... +w9(y16) x9 (3) 
The output signal of the presumed arithmetic circuit 7 is a signal which removal 
of block distortion completed, is outputted through an output terminal 8, for 
example, is supplied to a television receiver. 

[0025] Thus, after asking for the multiplier data for presuming the image data 
before being mosaic-ized corresponding to the mosaic-ized image data by study 
beforehand for every class, it memorizes on the ROM table 5 and calculates 
based on the multiplier data read from the image data and the ROM table 5 
which are inputted. And image data formation can be carried out and, unlike 



having only carried out band limit processing of the image data inputted, near 
data can be outputted by the image data before [ actual ] being mosaic-ized by 
[ for which the block distortion corresponding to the inputted image data was 
removed ] outputting. 

[0026] As mentioned above, object block B (0 0) The value of 16 pixels can 
remove block distortion, eight remaining blocks - attaching - **** - object block 
B (0 0) The value of the pixel within eight blocks is replaced by the average value 
of value y1 -y16 of the pixel obtained by being related. Namely, in this one 
example, processing of removal of block distortion is made for every block of 
=(3x3) 9 piece. Of course, although processing becomes complicated, to input 
image data, the field of a block of =(3x3) 9 piece is made to overlap, and it may 
be made to remove block distortion about all blocks. 

[0027] Then, the creation approach of the multiplier data stored in the ROM table 
5 is explained using drawing 2 . In order to obtain multiplier data by study, the 
mosaic image corresponding to the picture signal already known is formed first. 
As shown in drawing 2 , the blocking circuit 12 divides into a small block the 
picture signal supplied through an input terminal 11, and further, by the 
mosaic-ized circuit 13, the brightness value within each block is transposed to 



the average for every block, namely, specifically, is mosaic-ized. By the Di 
blocking circuit 14, the pixel data of the sequence of a block are changed for the 
mosaic-ized signal in order of a raster scan. The mosaic-ized picture signal is 
supplied to the pixel data extraction circuit 15 by these processings. 
[0028] From the picture signal supplied to the pixel data extraction circuit 15, 
data logging required for a class classification is performed. Specifically, the 
pixel data extraction circuit 15 carries out the same work as the pixel data 
extraction circuit 2 explained previously. The pixel data cut down by the pixel 
data extraction circuit 15 are supplied to the ADRC circuit 16. 
[0029] By performing an operation which compresses all the data of each field, 
or some data into 2-bit data from 8-bit digital image data as mentioned above, 
the ADRC circuit 16 forms pattern compressed data, and supplies this pattern 
compressed data to the class code generating circuit 17 while it detects the 
pattern of-like or two-dimensional 1 -dimensional level distribution of pixel data 
supplied for every field. The ADRC circuit 16 is the same as the ADRC circuit 3 
explained previously. 

[0030] The class code generating circuit 17 is the same as the class code 
generating circuit 4 explained previously, by calculating a formula (2) based on 



the pattern compressed data supplied from the ADRC circuit 16, detects the 
class to which the extracted pixel data belong, and outputs the class code which 
shows the class. The class code generating circuit 17 outputs a class code to the 
normal equation adder circuit 19. 

[0031] On the other hand, the supplied data are supplied to the normal equation 
adder circuit 19 through the delay circuit 18 prepared for timing doubling from 
the pixel data extraction circuit 15. Since this data is for using it for a presumed 
operation and the pixel used for the pixel used for a class classification in this 
example and a presumed operation is the same, the pixel data extraction circuit 
15 has the structure of serving as the extract of the pixel used for a class 
classification, and the extract of the pixel used for a presumed operation. 
[0032] Here, study of the transformation to the pixel which removed the 
mosaic-ized pixel to two or more block distortion, and the signal transformation 
using the prediction equation are described for explanation of the 
normal-equation adder circuit 19. Below, the case where generalize a pixel more 
for explanation and prediction by n pixels is performed is explained. 
[0033] They are x1, xn about the mosaic-ized pixel level, respectively. When 
it carries out and pixel level after conversion is set to y, they are multipliers w1 , 



wn for every class. The linearity presumption type of n tap to depend is set up. 

! 

This is shown in a formula (4). Before study, it is wi. It is an undetermined 

coefficient. 

[0034] 

y=w1 x1+w2 x2+ ..J +wn xn (4) 

[0035] Study is performed to two or more signal data for every class. When the 
number of data is m, the formula (5) shown below is set up according to a 
formula (4). 
[0036] 

yk =w1 xk1+w2 xk2+ ... +wn xkn (5) 
(k= 1,2, ... m) 

[0037] In m>n, they are w1 , wn. Since it is not decided that it will be a 
meaning, a formula (6) defines the element of the error vector e, and it asks for 
the multiplier which makes a formula (7) min. It is a solution method by the 
so-called least square method. 
[0038] 

ek =yk-{w1 xk1+w2 xk2+ ... +wn xkn} (6) 
(k= 1, 2, m) 
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[0039] 
[Equation 2] 

[0040] Here, it is wi of a formula (7). It asks for the partial differential coefficient 
to depend. It is each wi so that a formula (8) may be set to 0. What is necessary 
is just to ask. 
[0041] 
[Equation 3] 

[0042] Hereafter, it is XijYi like a formula (9) and a formula (10). If a definition is 
given, a formula (8) will be rewritten by the formula (11) using a matrix. 
[0043] 
[Equation 4] 

[0044] 
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[Equation 5] 



[0045] 
[Equation 6] 



[0046] Generally this equation is called the normal equation. The normal 

i 
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equation adder circuit 19 is the class code supplied from the class code 
generating circuit 17, and the mosaic-ized pixel data x1, xn which were 
supplied from the pixel data extraction circuit 15. This normal equation is added 
using the pixel data before mosaic[ which was supplied through the delay circuit 
20 prepared for timing doubling from the input terminal 21 ]-izing. 
[0047] After the input of all training data is completed, the normal-equation adder 
circuit 19 outputs normal-equation data to the prediction coefficient decision 
circuit 21. the prediction coefficient decision circuit 21 - a normal equation - 
sweeping out - general matrix solution methods, such as law, -- using - wi 
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******** - it solves and a prediction coefficient is computed. The prediction 
coefficient decision circuit 21 writes the computed prediction coefficient in 
memory 22. 

[0048] As a result of training as mentioned above, the prediction coefficient 
which can perform presumption statistical nearest to a true value for presuming 
the data y which removed block distortion from the pixel data mosaic-ized for 
every class is stored in memory 22. The data table stored in this memory 22 is 
the ROM table 5 used in the block distortion stripper of invention of the example 
mentioned above. By the above processing, study of the multiplier data for 
[ which removed block distortion from the pixel data mosaic-ized by the linearity 
presumption type ] carrying out data origination is completed. 
[0049] In addition, although it decided to prepare ADRC in explanation of an 
above-mentioned example as an information-compression means to patternize a 
space wave form with the small number of bits, this is an example, and as long 
as it is the information-compression means which can be expressed in a class 
with few patterns of a signal wave form, it is free what is formed, for example, it 
may establish compression means, such as DPCM (predicting coding) and VQ 
(vector quantization). 



[0050] Furthermore, although it was aimed at the removal of block distortion from 
the image data mosaic-ized completely in explanation of an above-mentioned 
example since it was easy, the block with which only the dc component of DCT is 
recorded / transmitted, or the block of 0-bit assignment of ADRC can realize 
removal of block distortion by the completely same processing as this. Moreover, 
removal of block distortion is realizable by applying this method also about the 
block which has signal change slightly. 
[0051] 

[Effect of the Invention] If it depends on this invention, the relation between a 
subject-copy image and the mosaic-ized data will be solved and modeled using 
the least square method using a linearity linear expression for each [ which 
carried out the class classification with the pattern of level distribution of the near 
image data of a processing-object block ] class of every, the multiplier of 
presumed operation expression will be determined, and it will change using that 
multiplier. Therefore, removal of a block distortion more highly efficient than 
before is realizable. 
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LThis document has been translated by computer. So the translation may not 
reflect the original precisely. 

2.**** shows the wo|rd which can not be translated. 
3. In the drawings, any words are not translated. 

DESCRIPTION OFiDRAWINGS 
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[Brief Description of the Drawings] 

[Drawing 1] It is thej block diagram of one example of the block distortion stripper 

concerning this invention. 

i 

[Drawing 2] It is thej block diagram showing one example which creates the 
multiplier table for conversion concerning this invention. 

[Drawing 3] It is drawing for explanation of the pixel used for a class 

i 

classification and ajpresumed operation. 

i 

[Drawing 4] It is drawing for explanation of the pixel to presume. 
[Description of Notations] 
12 Blocking Circuit 
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i 
i 



13 Mosaic-ized Circuit 

14 Di Blocking Circuit 

15 Pixel Data Extraction Circuit 

16 ADRC Circuit 

17 Class Code Generating Circuit 

18 20 Delay circuit 

19 Normal Equation Adder Circuit 

21 Prediction Coefficient Decision Circuit 

22 Memory 
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